Skip to content

[arrow] Fix Arrow to Paimon vector conversion casts#8138

Merged
JingsongLi merged 1 commit into
apache:masterfrom
luoyuxia:fix-arrow-vector-converter-8134
Jun 6, 2026
Merged

[arrow] Fix Arrow to Paimon vector conversion casts#8138
JingsongLi merged 1 commit into
apache:masterfrom
luoyuxia:fix-arrow-vector-converter-8134

Conversation

@luoyuxia
Copy link
Copy Markdown
Contributor

@luoyuxia luoyuxia commented Jun 5, 2026

Purpose

Fixes #8134.

This fixes Arrow2PaimonVectorConverter for Arrow vectors whose runtime type does not match the previous narrow casts:

  • support TimeSecVector, TimeMicroVector, and TimeNanoVector for TimeType, converting values to Paimon's millisecond representation.
  • support FixedSizeBinaryVector for BinaryType, while preserving VarBinaryVector compatibility.

Tests

  • mvn -pl paimon-arrow -Pfast-build -Dtest=ArrowFormatWriterTest#testArrowBundleRecordsWithTimeAndFixedBinaryVectors test
  • mvn -pl paimon-arrow -Dtest=ArrowFormatWriterTest#testArrowBundleRecordsWithTimeAndFixedBinaryVectors test

@JingsongLi
Copy link
Copy Markdown
Contributor

I reviewed this PR as part of a pass over recent open non-draft Paimon PRs. I did not find any clear correctness, compatibility, or regression issue to flag from the current diff.

@JingsongLi
Copy link
Copy Markdown
Contributor

+1

@JingsongLi JingsongLi merged commit a396015 into apache:master Jun 6, 2026
12 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Bug] Arrow2PaimonVectorConverter has ClassCastException for timestamp, time, and binary type conversions

2 participants